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© Method and apparatus for digitally processing a high definition television augmentation signal. 



© A method and apparatus for digital encoding are 
described for compressing the augmentation channel 
signals (chrominance and luminance signals for pan- 
el information and high frequency luminance and line 
sifference signal) so that this information can be 
transmitted in a 3 MHz wide RF channel using a 
digital transmission scheme such as QPSK. Analog 
signal components are sampled and converted to 
digital signals. Each of the signals is fed into a 
<N separate coder which reduces the number of 
^bits/pixel required to reconstruct the original signal. 
<g Compression is achieved by quantization and re- 
Iflmoval of redundancy. The compression scheme is 
I*** based on the use of DCT together with VLC. Each 
©augmentation signal has its own coder, which is 
O adapted to the unique statistics of this signal. 
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Method and apparatus for digitally processing a high definition television augmentation signal. 



BACKGROUND OF THE INVENTION 



The present invention relates to a method and 
apparatus for digitally processing the components 
of an augmentationsignal as part of a multi-channel 
high definition television (HDTV) delivery system. 
Such a system has been described for example in 
U.S. Patent 4,694,338 which is incorporated by 
reference herein. In such a system, an HDTV 
source signal, having for example a 16:9 aspect 
ratio and a 525 sequentially scanned or 1050, 2:1 
interlaced line structure, is divided into two signals. 
A conventional television signal, for example an 
NTSC encoded signal receivable on a standard 
broadcast receiver, is transmitted over a regular 
television transmission medium, for example a 
standard television channel and an augmentation 
signal providing the additional wider aspect ratio 
and high resolution information of the source signal 
is transmitted over a second transmission medium, 
for example a second television channel or part of 
one. A high definition receiver can then be used to 
receive and combine both signals into a high defi- 
nition television display. 



SUMMARY OF THE INVENTION 



The applications referred to hereinabove de- 
scribe systems utilizing analog augmentation signal 
configurations. For example, the systems described 
in U.S. Patent Applications 239.096 and 239,148 
(both filed on August 31. 1988) comprise embodi- 
ments using a standard 6MHz wide NTSC channel 
and a 3 MHz wide augmentation channel which 
could be transmitted on a presently unassigned 
television channel. The only available terrestrial 
channel capacity however, appears to be the so 
called "taboo" channels which are currently re- 
stricted for television transmission. If however, the 
amount of power needed to transmit the augmenta- 
tion signal on such a channel could be effectively 
reduced, use of these "taboo" channels could be- 
come practical. 

The instant application comprises a digital pro- 
cessing method and apparatus which digitally en- 
codes the augmentation signal components com- 
pressing them so that the information they provide 
can be transmitted in a narrow RF channel having 
for example a 3 MHz wide bandwidth, using a 
digital transmission scheme such as QPSK 
(quadraphase shift keying) . This permits a signifi- 
cant reduction of transmitted power on the aug- 



mentation channel, subsequently reducing the 
amount of interference to other channels using the 
same frequency band. Digital transmission of the 
augmentation signal not only permits the use of 
5 reduced power, but also enables taking advantage 
of the various known error detection, correction 
schemes, so that a better quality signal can be 
achieved. 

A major disadvantage of digital transmission is, 

70 however, the increase in the transmission band- 
width necessary. The increased bandwidth requires 
either the use of a channel with a wider bandwidth 
or implementation of data compression schemes to 
reduce the required bandwidth. The invention com- 

js prises an approach for encoding the enhancement 
signals based on the latter solution. 

Extensive research in the area of image coding 
has shown that two-dimensional (2-D) discrete 
block cosine transform (DCT) encoding has attrac- 

20 tive performance compared to other encoding tech- 
niques while being practical for hardware imple- 
mentation. However, these investigation have tradi- 
tionally dealt with standard full-band signals. The 
compression scheme used herein is a modified 

25 version of one described in a paper entitled 
"Adaptive Intra Inter Frame DCT Coding of TV Pic- 
tures". June 1988, C. Remus (LEP Philips, France) 
and the implementation of a two-dimensional DCT 
with VLC for full band two-dimensional signals 

30 (regular images) was first introduced by W. Chen 
and W.K. Pratt in a paper entitled "Scene Adaptive 
Coder" (IEEE Transaction on Communications, 
March 1984) . The results of these studies cannot 
be readily extended to the encoding of augmenta- 

35 tion signals which in part possess only high fre- 
quency content. These articles are incorporated by 
reference herein. 

Augmentation signal components derived using 
for example, an HDNTSC encoder such as the one 

to described in U.S. Patent Application 084,968, filed 
August 13, 1987 and an encoder first described in 
U.S. Patent 4,694,338 (issued on September 15, 
1987), and comprising, for example, a luminance 
panel signal Y p , two chrominance panel signals (l p 

45 and Q p ) , a high frequency luminance signal YH 
and a line difference signal LD, are those pro- 
cessed in accordance with the invention. The in- 
stant invention takes these augmentation signal 
components, samples them and converts them into 

so for example, 8 bit per pixel digital signals. Each of 
these digital signals is then fed into a separate 
coder which reduces the number of bits per pixel 
required to reconstruct the original signal compo- 
nents. This compression is achieved by quantiza- 
tion and removal of redundancy. By quantization, 
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we mean the elimination of certain information. The 
compression scheme is based on the use of DCT 
(discrete cosine transform) processing in combina- 
tion with VLC (variable length coding) and each 
augmentation signal component has its own coder, 
which is adapted to its unique characteristics. 



BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is a diagram of an encoder de- 
scribed in U.S. Patent No. 4,694,338. 

Figure 2 is a diagram of a high definition 
NTSC (HDNTSC) encoder described in U.S. Patent 
Application No. 084,968. 

Figure 3 is a flow diagram representing a 
general description of the digital processing and 
transmission scheme of the instant invention. 

Figure 4a describes one embodiment of a 
coder for the panel information. 

Figure 4b describes one embodiment of a 
decoder for panel information. 

Figure 5 describes the reordering of pro- 
cessed panel information. 

Figure 6 is a graph representing the buffer 
regulation procedure. 

Figure 7 is a graph describing the criteria for 
determining the weights for panel information. 

Figure 8 describes one embodiment of an 
LD encoder. 

Figure 9 describes one embodiment of an 
LD decoder. 

Figure 10 describes the reordering of LD 
information. 

Figure 11 describes one embodiment of a 
YH coder. 

Figure 12 describes one embodiment of a 
YH decoder. 

Figure 13 describes the reordering of YH 
information. 

DETAILED DESCRIPTION OF THE INVENTION 



Figure 1 is one embodiment of en encoder 
which can be used to derive luminance and 
chrominance signal components for both center 
and panel portions of a high definition television 
source signal. The operation of this encoder 10 and 
its use in the derivation of an augmentation signal 
is fully described in the '338 patent in which this 
figure appears as Fig. 4. As explained therein, a 
HDTV source is processed and outputs 18, 20 and 
22 of the 3-channel demultiplexer 32 provide re- 
spectively, a luminance (Y c ), and two chrominance 
components, for example Q c and l c , for the center 
portion of the HDTV source. This center portion 



presents picture information which, as taught by 
the '338 patent, is then NTSC encoded and trans- 
mitted over one standard television channel. The 
outputs 12, 14 and 16 of 3-channel demultiplexer 
5 32 provide respectively Y p , Q p and l p components 
for the panels derived from the HDTV source sig- 
nal. 

Figure 2 describes an HDNTSC encoder which 
utilizes the encoder 10 in conjunction with band 

w pass filter 35 to derive a high frequency luminance 
component YH from the HDTV source signal. This 
encoder is disclosed as Fig. 2a of the '968 applica- 
tion which describes a system providing extended 
horizontal resolution of luminance and chrominance 

75 in a high definition television system. The YH com- 
ponent 36 is available at the output of the band- 
pass filter (BPF) 35. A line difference (LD) signal 
component is available at output 38. 

The described embodiment of the instant in- 

20 vention provides for the processing and transmis- 
sion of the derived augmentation signal in an ap- 
proximately 3 MHz wide RF channel. The aug- 
mentation signal consists, for example, of the fol- 
lowing signal components: Y p , l p , Q p , LD and YH. It 

25 should be noted that in the analog two channel 
system described in the '096 application the I, and 
Q signals for panels are modulated in quadrature to 
produce a signal chrominance signal, whereas here 
separate I and Q signal components are provided 

30 for in the augmentation signal. 

A flow diagram of one embodiment of the 
digital compression and transmission scheme of 
the invention is shown in Figure 3. Each of the 
signal components is fed through a separate ana- 

35 log to digital converter (A D) which uses a sampling 
frequency approximately twice the bandwidth of the 
respective signal component. In this way the lowest 
possible number of samples/sec is obtained beofre 
coding. The analog augmentation signal compo- 
se nents Y p , Q p , l p , LD and YH are bandlimited as 
described in Table 1. Like the applications cited 
herein, the augmentation signal of the instant in- 
vention utilizes a line period of approximately 127 
us and better known and described in these ap- 

45 plications as a "superline". Table 1 shows how the 
number of Megasamples/sec. is computed for each 
of the signal components. After sampling, each of 
the digital signal components is converted into a 
stream of 8 bit pixels or samples 52. The resulting 

so number of megasamples/sec for the signal compo- 
nents is 2.54 MS/sec, 0.36 MS/sec, 0.72 MS/sec, 
2.74 MS/sec, and 2.46 MS/sec for Q p , l p , LD and 
YH, respectively. The digital signal components are 
then passed through separate coders labeled 

55 CoderP, CoderQ, Coderl, CoderLD, and CoderYH 
53. Average resulting compression rates are about 
1 .0 bits/pixel for Y p , l p and Q p . Rates of about 0.2 
bits/pixel for LD and about 0.3 bits/pixel for YH 
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have also been achieved. The digital signal compo- 
nents are then multiplexed into a single bit stream 
55. Based on previous computations of MS sec and 
average compression rates, this bit stream will 
have bit rate of about 4.91 Megabits/sec. With an 
additional overhead of 20% added for error protec- 
tion (see below) the bitrate is 5.89 Mb sec. Com- 
putation of bit rate for each of the signal compo- 
nents and the combined signal is illustrated by 
Table 2. The column of Table 2 marked "Coding 
Rate" indicates the operating rate of the system for 
each of the signal components. This constraint is 
imposed on each coder. 

Conventional error protection compensation 
methods can be used 56 to process the bit stream 
prior to modulation and transmission in order to 
mitigate the effects of noise in the transmission 
channel medium. The bit stream can be transmit- 
ted in a 3 MHz wide RF channel using for example 
a 2 bitsecHz QPSK transmission scheme 58. 

At the receiving end, the QPSK bit stream is 
received and demodulated 60, and any error 
protection-compensation method used is compen- 
sated for 62. The demodulated bit stream is then 
demultiplexed into individual compressed digital 
augmentation signal components Y p , Q p , l p , LD and 
YH 64. These compressed signals are then de- 
coded by passing each signal through its own 
decoder 66. The recovered digital augmentation 
signal components can now be converted back into 
analog form and fed into a 2 channel decoder 
which is fully described in for example, the '968 
application 68. 

The block diagram of an embodiment of a 
coder for panel information, i.e. Y p , l p , or Q p , is 
shown in Fig. 4a. The panels from two consecutive 
fields are combined to produce one panel frame. 
More specifically, the even numbered lines of even 
numbered fields are interleaved with odd numbered 
lines of odd numbered fields. The resulting com- 
bination is regarded as one frame of panels and 
focus the input 100 of the panel encoder 53a. The 
frame is partitioned into separate blocks of equal 
size N, where N = 16 and two-dimensional (2-D) 
discrete cosine transform (DCT) processing is ap- 
plied separately and independently on each block 
using transform means 110. 

The coder 53a operates on a block by block 
basis and performs the same series of operations 
on each block. Its operation therefore, will be de- 
scribed only for one block represented by x(i,j) . 
Here, we will assume that the blocks in one frame 
are indexed from left to right and top to bottom 
(i.e., similar to a raster scan .format) and the index- 
ing is continued in a similar fashion for subsequent 
frames. After the 2-D DCT transformation, the dc 
coefficient, X(0,0), which represents the average 
gray level or luminance of the block, is separately 



quantized using for example a 9-bit quantizer 112 
(a simple float to integer rounding operation) the 
output of which is then provided to multiplexer 1 15. 
The rest of the coefficients X(u,v) where {u,v = 

5 0,1 .... ,N, N - 1 ; (u.v) *(0,0)}, are treated separately 
as described below. The activity of each block, 
which is indicative of amount of detail (for example 
edge content) of the block, is then calculated and 
classified using block classification means 114 ac- 

io cording to the formula: 
A(m,n) = max | X (u,v)j 
<u,v)*(0,0) 

u.v = {0,1 N-1}, 

where A(m,n) represents the activity of the block 
75 (m,n) The block is then assigned to one of K = 4 
activity classes, using a fixed set of decision levels 
0 = TO < t = 10 < t 2 = 25 < r 3 = 50 < TO. = 
255. 

That is, block (m.n) is assigned to class k if T k .i 5 
20 A(m.n) < r k . The assigned class of the block re- 
quires two bits (log24) of information to be uniquely 
identifiable. The assigned class along with the nor- 
malization factor, (described below) are then used 
to select a set of weights suitable for that class and 

25 normalization factor. Selection of the appropriate 
weights takes place using weighting means 116. 
The weights associated with all coefficients indexed 
by n = (u + v),2, where n = 0,1. . . .2(N-1) are 
calculated according to the formula: 

30 «,<n) = coi(N - 1) +[a>,(N - 1) - 1] (n - N + 1)/<kN), 
where i indicates the block number or the operating 
state. Calculation of these weights is illustrated by 
the graph of Figure 1 . As is clear form the previous 
expression, the weight assigned to each coefficient 

35 depends on the calculated value of <oi(n - 1) , 
referred to as the central coefficient or the nor- 
malization factor which is in turn evaluated using 
normalization means 124 according to formula 
<Oi(N) = f(»i.i(N), b s ). 

40 Here, f(.) is a piece-wise linear function having a 
buffer status (b s ) as shown in the graph of Figure 6. 
The buffer status is described as the ratio of num- 
ber of bits in the buffer 12 to the buffer size. 

All the transform coefficients, except for the dc 

45 coefficient, are divided by the weights calculated 
as above 118 and then quantized using a simple 
float to integer rounding operation in quantizer 120. 
The output of the quantizer 120, (u,v) , can then 
be reordered (scanned) 122 using the pseudo zig- 

50 zag scanning pattern illustrated in Fig. 5 in order to 
provide better match for the variable-length coder 
(VLC) 128. 

The VLC 128 consists of several tables, each 
designed for a specific normalization value ^{N - 
55 1), and activity class, k. The normalized values 
provide a better match to input statistics than 
previosuly provided by single coders such as those 
described by the prior art. The appropriate table, 
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selected based on the normalization value and 
class assignment, is then used to encode (u,v) 
to the VLC 128. The output of VLC 128 is fed to 
buffer 126 for further preparation (channel coding 
and modulation) for transmission. The status (b s ) of 
the buffer 126 is then updated and the normaliza- 
tion value for the next block, i + 1, is calculated 
using normalization means 124. The output of buff- 
er 126 is combined with the output of quantizer 112 
and the respective block class provided by block 
classification means 114, in multiplexer 115. The 
multiplexed output is then modulated on to a car- 
rier in modulator 117 and transmitted over part (i.e. 
3 MHz) of a television channel 119. 

The role of the decoder 53b, in the absence of 
transmission errors, is to recover the digital signal 
components input to the coder 53a, allowing for 
some degradation due to quantization depending 
on the operating rate of the system. 

Figure 4b describes one embodiment of a de- 
coder for panel information, i.e. Y p l p or Q p . The 
information on channel 119 is demodulated by de- 
modulator 121 and the dc coefficient X(0,0) is 
separated from the rest of the coefficients and the 
respective assigned block class in demultiplexer 
125 and provided to inverse DCT transformation 
means 123. The rest of the demultiplexed coeffi- 
cients are input to buffer 130. The output of the 
buffer 130 is fed to the variable-length decoder 
(VLD) 132 while the status of the buffer 130 is used 
to calculate, using normalization means 134, the 
normalization value used in the coder 53a. The 
respective assigned block class is provided from 
demultiplexer 125 to weighting means 13b. The 
normalization value from 134 and the assigned 
block class 125a from demultiplexer 125 are input 
to and thereby enable the VLD 132 to select the 
table used in the VLC 128 and therefore to recover 
the value of the coefficients, (u ,v). The resulting 
coefficients are then processed 132a to compen- 
sate for any recording process used during encod- 
ing. Weighting means 13b derives the weight fac- 
tors used in encoder 53a for the coefficients (using 
the block class and normalization factors) and 
these factors are then combined in multiplier 140 
with the processed coefficients from VLD 132. 
Along with the dc coefficients, X(0,0), coefficients 
X(u,v) are inverse transformed in inverse DCT 
means 123 to provide the output of the decoder X- 
(ij). 

The encoding and decoding procedures for LD 
components are similar to those for the panel com- 
ponents as shown in block diagrams Figs. 8 and 9. 
Because of peculiar nature of the LD component, 
there is no weighting of the DCT coefficients. That 
is, all the coefficients are normalized using the 
same normalization value. In addition, the (0,0) 
coefficient in DCT domain is treated the same as 



the rest of coefficients. Furthermore, the recording 
method using for LD is chosen to better suit the 
statistical properties of this signal and is shown in 
Fig. 10. Test results showed that the value of the 

5 normalization factor is usually small and therefore 
only one codebook is used in the VLC and the 
normalization value is taken as a real number. 

Block diagrams representing the operation of 
embodiments of an encoder and decoder for YH 

10 are shown in Figs. 11 and 12. The operation of the 
encoder for YH is very similar to that for LD except 
that the reordering process, shown in Fig. 13, is 
selected to better suit the properties of the YH 
component. In the above described embodiments, 

;5 the means for transforming, normalizing weighting 
and variable length encoding/decoding the signal 
components can be accomplished using hardware 
or a computer program. Persons skilled in the art 
will be able to provide the means shown and use 

20 them in accordance with the instant invention. 

The foregoing disclosure and description of the 
invention is illustrative and explanatory thereof and 
various changes in the details of the embodiments 
shown may be made within the scope of the ap- 

25 pended claims without departing from the spirit of 
the invention. 



Claims 

30 

1. A method for digitally processing a high 
definition television (HDTV) signal comprised of a 
plurality of signal components, said method com- 
prising the steps of: 

35 a) deriving said signal components from a 

high definition television source; 

b) digitizing said signal components forming 
thereby a plurality of digitized components and; 

c) compressing each of said digitized com- 
40 ponents in a coder optimized for its respective 

digitized component. 

2. The method of claim 1 wherein each said 
coder compresses its respective digitized compo- 
nent using a discrete cosine transform process and 

45 a variable length coding process. 

3. The method of claim 1 wherein said signal 
components comprise at least one luminance com- 
ponent and at least one chrominance component. 

4. An apparatus for digitally processing an 
so HDTV signal comprises of a plurality of signal 

components, said apparatus comprising: 

a) means for deriving said signal compo- 
nents from a high definition television source; 

b) digitizing means coupled to said deriving 
55 means for digitizing said signal components for- 
ming thereby a plurality of digitized components 
and 

c) coding means coupled to said digitizing 
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means for compressing each of said digitized com- 
ponents in a manner optimized for said respective 
component. 

5. The apparatus of claim 4 wherein each of 
said coding means compresses its respective 5 
digitized component using a discrete cosine trans- 
form process and a variable length coding process. 

6. The apparatus of claim 4 wherein said signal 
components comprise at least one luminance com- 
ponent and at least one chrominance component. ?o 

7. A system for transmitting and receiving an 
HDTV signal wherein an HDTV source signal is 
divided into a conventional television signal and an 
augmentation signal and wherein said augmenta- 
tion signal, when combined at a receiver with said 15 
conventional signal recreates said HDTV source, 
characterized in that said augmentation signal is 
digital in form and comprises of a plurality of digital 
signal components derived from said HDTV source 
signal and each is processed using a separate 20 
coder. 
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